Results from an Evaluation of a Dialogue Manager

نویسنده

Melita Hajdinjak

چکیده

We give the results from an evaluation of the dialogue manager of a developing, Slovenian and Croatian spoken dialogue system for weather-information retrieval. The results are based on two Wizard-of-Oz experiments and the application of the PARADISE evaluation framework. The only difference between both experiment settings is in the dialogue-management manner, i.e., while in the first experiment dialogue management was performed by a human, the wizard, in the second experiment it was performed by the newly-implemented dialogue-manager component.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

An Information State-Based Dialogue Manager for Call for Fire Dialogues

We present a dialogue manager for “Call for Fire” training dialogues. We describe the training environment, the domain, the features of its novel information statebased dialogue manager, the system it is a part of, and preliminary evaluation results.

متن کامل

Training and Evaluation of the HIS POMDP Dialogue System in Noise

This paper investigates the claim that a dialogue manager modelled as a Partially Observable Markov Decision Process (POMDP) can achieve improved robustness to noise compared to conventional state-based dialogue managers. Using the Hidden Information State (HIS) POMDP dialogue manager as an exemplar, and an MDP-based dialogue manager as a baseline, evaluation results are presented for both simu...

متن کامل

Deliverable D 1 . 5 Working Paper on Dialogue Management Current Practice

This paper summarises key aspects of current practice in dialogue manager development and evaluation for commercial and research spoken dialogue systems (SLDSs). Dialogue management is arguably the core functionality of SLDSs because the dialogue manager tends to have the controlling function of the system as a whole and maintains a model of the evolving dialogue context. The paper is based on ...

متن کامل

An information state based dialogue manager for a mobile robot

The paper focuses on an Information State (IS) based dialogue manager developed for Carl, an intelligent mobile robot. It uses a Knowledge Acquisition and Management (KAM) module that integrates information obtained from various interlocutors. This mixed-initiative dialogue manager (DM) handles pronoun resolution, is capable of performing different kinds of clarification/confirmation questions ...

متن کامل